W-FYD: a Wearable Fabric-based Display for Haptic Multi-Cue Delivery and Tactile Augmented Reality

Despite the importance of softness, there is no evidence of wearable haptic systems able to deliver controllable softness cues. Here, we present the Wearable Fabric Yielding Display (W-FYD), a fabric-based display for multi-cue delivery that can be worn on user's finger and enables, for the first time, both active and passive softness exploration. It can also induce a sliding effect under the finger-pad. A given stiffness profile can be obtained by modulating the stretching state of the fabric through two motors. Furthermore, a lifting mechanism allows to put the fabric in contact with the user's finger-pad, to enable passive softness rendering. In this paper, we describe the architecture of W-FYD, and a thorough characterization of its stiffness workspace, frequency response and softness rendering capabilities. We also computed device Just Noticeable Difference in both active and passive exploratory conditions, for linear and non-linear stiffness rendering as well as for sliding direction perception. The effect of device weight was also considered. Furthermore, performance of participants and their subjective quantitative evaluation in detecting sliding direction and softness discrimination tasks are reported. Finally, applications of W-FYD in tactile augmented reality for open palpation are discussed, opening interesting perspectives in many fields of human-machine interaction

Hap-Pro: a wearable haptic device for proprioceptive feedback

Objective: Myolectric hand prostheses have reached a considerable technological level and gained an increasing attention in assistive robotics. However, their abandonment rate remains high, with unintuitive control and lack of sensory feedback being major causes. Among the different types of sensory information, proprioception, e.g. information on hand aperture, is crucial to successfully perform everyday actions. Despite the many attempts in literature to restore and convey this type of feedback, much remains to be done to close the action-perception loop in prosthetic devices. Methods: With this as motivation, in this work we introduce HapPro, a wearable, non-invasive haptic device that can convey proprioceptive information for a prosthetic hand. The device was used with an under-actuated, simple to control anthropomorphic robotic hand, providing information on the level of hand aperture by mapping it to the position of a wheel that can run on the user's forearm. Tests with 43 able bodied subjects and one amputee subject were conducted in order to quantify the effectiveness of HapPro as a feedback device. Results: HapPro provided a good level of accuracy for item discrimination. Participants also reported the device to be intuitive and effective in conveying proprioceptive cues. Similar results were obtained in the proof-of-concept experiment with an amputee subject. Conclusions: Results show that HapPro is able to convey information on the opening of a prosthetic hand in a non-invasive way. Significance: Using this device for proprioceptive feedback could improve usability of myoelectric prostheses, potentially reducing abandonment and increasing quality of life for their users

A Synergy-Based Optimally Designed Sensing Glove for Functional Grasp Recognition

Achieving accurate and reliable kinematic hand pose reconstructions represents a challenging task. The main reason for this is the complexity of hand biomechanics, where several degrees of freedom are distributed along a continuous deformable structure. Wearable sensing can represent a viable solution to tackle this issue, since it enables a more natural kinematic monitoring. However, the intrinsic accuracy (as well as the number of sensing elements) of wearable hand pose reconstruction (HPR) systems can be severely limited by ergonomics and cost considerations. In this paper, we combined the theoretical foundations of the optimal design of HPR devices based on hand synergy information, i.e., the inter-joint covariation patterns, with textile goniometers based on knitted piezoresistive fabrics (KPF) technology, to develop, for the first time, an optimally-designed under-sensed glove for measuring hand kinematics. We used only five sensors optimally placed on the hand and completed hand pose reconstruction (described according to a kinematic model with 19 degrees of freedom) leveraging upon synergistic information. The reconstructions we obtained from five different subjects were used to implement an unsupervised method for the recognition of eight functional grasps, showing a high degree of accuracy and robustness

The Rice Haptic Rocker: Skin stretch haptic feedback with the Pisa/IIT SoftHand

Touch provides an important cue to perceive the physical properties of the external objects. Recent studies showed that tactile sensation also contributes to our sense of hand position and displacement in perceptual tasks. In this study, we tested the hypothesis that, sliding our hand over a stationary surface, tactile motion may provide a feedback for guiding hand trajectory. We asked participants to touch a plate having parallel ridges at different orientations and to perform a self-paced, straight movement of the hand. In our daily-life experience, tactile slip motion is equal and opposite to hand motion. Here, we used a well-established perceptual illusion to dissociate, in a controlled manner, the two motionestimates. According to previous studies, this stimulus produces a bias in the perceived direction of tactile motion, predicted by tactile flow model. We showed a systematic deviation in the movement of the hand towards a direction opposite to the one predicted by tactile flow, supporting the hypothesis that touch contributes to motor control of the hand. We suggested a model where the perceived hand motion is equal to a weighted sum of the estimate from classical proprioceptive cues (e.g., from musculoskeletal system) and the estimate from tactile slip

From humans to robots: The role of cutaneous impairment in human environmental constraint exploitation to inform the design of robotic hands

Human hands are capable of a variety of movements, thanks to their extraordinary biomechanical structure and relying on the richness of human tactile information. Recently, soft robotic hands have opened exciting possibilities and, al the same time, new issues related to planning and control. In this work, we propose to study human strategies in environmental constraint exploitation to grasp objects from a table. We have considered both the case where participants' fingertips were free and with a rigid shell worn on them to understand the role of cutaneous touch. Main kinematic strategies were quantified and classified in an unsupervised manner. The principal strategies appear to be consistent in both experimental conditions, although cluster cardinality differs. Furthermore, as expected, tactile feedback improves both grasp precision and quality performance. Results opens interesting perspective for sensing and control of soft manipulators

ThimbleSense: a fingertip-wearable tactile sensor for grasp analysis

Accurate measurement of contact forces between hand and grasped objects is crucial to study sensorimotor control during grasp and manipulation. In this work we introduce ThimbleSense, a prototype of individual-digit wearable force/torque sensor based on the principle of intrinsic tactile sensing. By exploiting the integration of this approach with an active marker-based motion capture system, the proposed device simultaneously measures absolute position and orientation of the fingertip, which in turn yields measurements of contacts and force components expressed in a global reference frame. The main advantage of this approach with respect to more conventional solutions is its versatility. Specifically, ThimbleSense can be used to study grasping and manipulation of a wide variety of objects, while still retaining complete force/torque measurements. Nevertheless, validation of the proposed device is a necessary step before it can be used for experimental purposes. In this work we present the results of a series of experiments designed to validate the accuracy of ThimbleSense measurements and evaluate the effects of distortion of tactile afferent inputs caused by the device's rigid shells on grasp forces

A Finite element model of tactile flow for softness perception

Touch is an extremely dynamic sense. To take into account this aspect, it has been hypothesized that there are mechanisms in the brain that specialize in processing dynamic tactile stimuli, in a way not too dissimilar from what happens for optical flow in dynamic vision. The concept of tactile flow, related to the rate of expansion of isostrain volumes in the human fingerpad, was used to explain some perceptual illusions as well as mechanisms of human softness perception. In this paper we describe a computational model of tactile flow, and apply it to a finite element model of interaction between deformable bodies. The shape and material properties of the bodies are modeled from those of a human fingertip interacting with specimens with different softness properties. Results show that the rate of expansion of isostrain volumes can be used to discriminate different materials in terms of their softness characteristics

Synergy-driven performance enhancement of vision-based 3D hand pose reconstruction

In this work we propose, for the first time, to improve the performance of a Hand Pose Reconstruction (HPR) technique from RGBD camera data, which is affected by self-occlusions, leveraging upon postural synergy information, i.e., a priori information on how human most commonly use and shape their hands in everyday life tasks. More specifically, in our approach, we ignore joint angle values estimated with low confidence through a vision-based HPR technique and fuse synergistic information with such incomplete measures. Preliminary experiments are reported showing the effectiveness of the proposed integration

Towards a Novel Generation of Haptic and Robotic Interfaces: Integrating Active Physiology in Human-Robot Interaction

Haptic interfaces are special robots that interact with people to convey touch-related information. In addition to such a discriminative aspect, touch is also a highly emotion-related sense. However, while a lot of effort has been spent to investigate the perceptual mechanisms of discriminative touch and to suitably replicate them through haptic systems in human robot interaction (HRI), there is still a lot of work to do in order to take into account also the emotional aspects of tactual experience (i.e., the so-called affective haptics), for a more naturalistic human-robot communication. In this paper, we report evidences on how a haptic device designed to convey caress-like stimuli can influence physiological measures related to the autonomous nervous system (ANS), which is intimately connected to evoked emotions in humans. Specifically, a discriminant role of electrodermal response and heart rate variability can be associated to two different caressing velocities, which can also be linked to two different levels of pleasantness. Finally, we discuss how the results from this study could be profitably employed and generalized to pave the path towards a novel generation of robotic devices for HRI